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ABSTRACT 

Certain thermal non-equilibrium situations, outside of the astrophysical 
realm, suggest that entropy production extrema, instead of entropy extrema, 
are related to stationary states. In an effort to better understand the evolution 
of collisionless self-gravitating systems, we investigate the role of entropy produc- 
tion and develop expressions for the entropy production rate in two particular 
statistical families that describe self-gravitating systems. From these entropy 
production descriptions, we derive the requirements for extremizing the entropy 
production rate in terms of specific forms for the relaxation function in the Boltz- 
mann equation. We discuss some implications of these relaxation functions and 
point to future work that will further test this novel thermodynamic viewpoint 
of collisionless relaxation. 

Subject headings: galaxies: structure — galaxies:kinematics and dynamics 



1. Introduction 

Galaxy-hosting dark matter systems and the galactic stellar systems themselves act 
collisionlessly over Hubble timescales. Understanding the evolution of self-gravitating, col- 
lisionless systems is a foundational element to the larger picture of galaxy evolution. Much 
of the advancement in understanding collisionless evolution has come from iV-body sim- 
ulations that focus on the motions of large numbers of individual mass elements. Such 
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result from a variety of initial conditions (< 




van Albada 


1982; 


Merritt & Aeuilar 


1985 


Navarro. Frenk. & White 


1996; 


Moore et al. 


1998). 



While iV-body simulations have given the astrophysics community a powerful method 
for making predictions that can be tested against observations, the modeled evolutions are 
sufficiently complex that a full physical picture of the evolution remains lacking. Effects such 
as dynamical friction, collisionless relaxation processes, and even numerical artifacts can all 
play roles of varying importance in these simulations. Astrophysicists now have substantial 
empirical evidence that collisionless systems in cosmological contexts have "universal" equi- 
librium distributions of mass and vel ocities, e.g., the radial power-law behavior of density 
divided by velocity dispersion cubed ( iTaylor fc Navarro! 1200 ll ). We are interested in gaining 
a better understanding of the physical origin of these seemingly special distributions. 

Before beginning to build a physical picture of collisionless evolution, let us quickly 
review some of the ideas that are involved. Thermal equilibrium is the state that systems 
relax towards when energy can be exchanged between the components of the system. A 
system in thermal equilibrium is characterized by a minimum internal energy or, equivalently, 
a maximum entropy. In a thermodynamic sense, entropy is linked to the amount of energy 
transferred as heat, bringing with it a connotation of randomness. In a statistical sense, 
entropy is simply a redefinition of the accounting of energy states in a system. Relaxation is 
a generic term for any process that erases the memory of initial conditions in a system. For 
example, gases reach the completely relaxed state of thermal equilibrium through collisions. 



Lynden- Belli (119671 ) demonstrated that non-degenerate collisionless self-gravitating sys- 
tems with finite mass and energy do not have a state of maximum entropy when one works 
with the standard distribution function and assumes that the occupation numbers of phase- 
spa ce volumes is large enoug h that Stirling's approximation applies (For an alternative view 



sec 



Hjorth fc Williams! 120101 ) . This lack of entropy extremum implies that there is no ther- 
mal equilibrium state for such systems. And yet, mechanical equilibrium, a state with no 
net force at any location, is possible. In stellar interiors, for example, the lack of thermal 
equilibrium — evidenced by gradients in temperature and pressure — is required for mechan- 
ical equilibrium. Note that the thermal non-equilibrium description refers to the entire 
star. It is common to treat the gas in a star as being in local thermodynamic equilibrium, 
where small regions of the star are modeled as having uniform temperatures. In this work, 
we consciously make a distinction between full thermal equilibrium and stationary (time- 
independent) situations. An example that clarifies this difference is familiar to those of us 
nearer the poles. On a cold winter day, a house is heated to a temperature that is well above 
the outside air temperature. Heat flows out of the house, and entropy is generated in a wall 
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during the energy transfer. As long as the home's heating system runs and the outdoor 
temperature remains constant, this process will be steady-state, yet it does not represent a 
thermal equilibrium as the entropy of the home-outside air system continually increases. 

Dark matter halos and galactic stellar systems are similar to the above, in the sense 
that they have temperature gradients and are thus thermally non-equilibrium systems, even 
though they are steady-state and are in mechanical equilibrium. 

Thermal non-equilibrium systems are common in nature and have been the subject of 
numerous studies. For certain non-astrophysical, non-gravitating systems it was found that 
stationar y states, like mechanical equilibrium, c oincide with states of extreme entropy pro- 
duction (jde Groot fc Mazurlll984l ; lGrandyll2008l . and references therein). In some instances, 
it appears that steady-states are reached by minimizing entropy production, while in other 
cases maximizing entropy production is the requirement. The most common modern for- 



mulation of the principle of maximum en tropy productio n is due to IZieglerl (119611 ). The 
principle of miminum entropy production ( )Pr igo gind 1 1 9 781 ) appears to have a smaller range 
of applicability, but does find uses in physics, chemistry and biology. The theoretical inter- 
pretation, and the relation between the two seemingly contra dictory principles is still being 



worked out (e.g... iMartyushev fc Seleznevll2006l ; lBordelll2010l ) 



A further, and more general reason to explore entropy production in self-gravitating sys- 
tems is because irreversability and entropy production are closely related concepts. The "mi- 
croscopic" equation of motion of gravity (and of other microscopic physics) is time-reversible, 
while the global evolution of the system is not, in the sense that it has a definite arrow of 
time. A natural agent that can make the transition from reversability to irreversability in 
macroscopic systems is the thermodynamic entropy production. 

This ability of thermodynamics to pick the arrow of time thro ugh non-zero (positive) 
entrop y production has been utilized in a cosmological context by iPrigogine fc Geheniau 
( 119861 ). These authors propose a scenario where in the early Universe some of the energy 
of the space-time (gravity) was transferred to matter. Because matter production is an 
irreversible, entropy creating process, the evolution of the Universe proceeds with an arrow 
of time. 

In this paper we investigate the consequences of applying the entropy production ex- 
tremization principle to self-gravitating systems. We do not prove that such a principle 
should be applicable here; we merely explore what this principle implies. In particular, we 
want to find what conditions are necessary to extremize entropy production and how those 
conditions differ from maximizing the total entropy. 



We begin with a review of relevant ideas regarding entropy from both a thermodynamic 
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and statistical point of view in Section EJ In § [3], entropy production equations for the two 
statistical families we are interested in are then derived. For these cases, we also develop 
the specific forms for collisionless relaxation processes required to extremize the entropy 
production. We present a discussion of our results and conclude in Section HI 



2. Background 
2.1. Brief Outline 



Much of what follows is a distilled derivation of the outcome of extemizing entropy 
production in collisionless systems. As the mathematical details might muddy the overall 
flow of the paper, we present an executive summary to draw the reader's attention to the 
main equations and the connections between them. 



• We start by developing a continuity equation for entropy density (ps), which has an 
entropy production source term a (see Equation [6]). 

• Statistical descriptions of entropy and entropy density are derived from enumerat- 
ing states accessible to the system. Entropy density expressions for both Maxwell- 
Boltzmann and Lynden-Bell statistical families may be found in Equations [16] and [30] 
respectively. These expressions depend on the coarse-grained distribution function, /. 

• Taking the partial time derivative of ps in Equations [16] and [30] produces Equations [T71 
and ED respectively. These diffentiations result in df/dt terms, which we replace using 
the Boltzmann Equation ( I13p . This introduces the relaxation function T, as shown in 
Equations [18] and [32] respectively. 

• Expressions of the entropy production o for both statistical families are identified by 
comparing terms resulting from Equations [18] and [32] to those in Equation [6] 

• Finally, we set the variation of the a expressions equal to zero. This procedure then 
yields the T functions found in Equations [28] and HH] respectively. 



2.2. Entropy Behavior 



Following Ide Groot fc Mazurl (119841 Ch. 3), we argue that there are two ways to change 
the total entropy of a system; 1) entropy can enter or leave through a flux, or 2) entropy 
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may be created within the system. Note that to be in accord with the second law of ther- 
modynamics during the system's evolution, the system's entropy should not decrease. A 
straightforward approach to dealing with entropy changes in time is, 

dS _dS^ dS^ 

where the total entropy is, 

S= I ps dx, (2) 



is the flux entropy, and is the created entropy. Unless noted otherwise, all integra- 
tions are assumed to be over all configuration and/or velocity space. The value of the flux 
entropy depends on how much entropy is entering or leaving the system through a bounding 
surface, 



dt 



= - / (S + psv ) ■ dA (3) 
Js 

= - / V • (£ + psv ) dx, 
Jv 



where S is an entropy flux normal to the surface S, psv is the entropy convected through 
the surface by mean motions, the minus sign is convention, and the last equality results from 
the divergence theorem. The flux X is the result of random motions within a system. In 
as much as random motions can be linked to thermal energy, one can think of the random 
flux as being associated with heat. The subscripts on the integrals simply draw attention to 
the change in integration range. The entropy creation term is likewise related to a quantity 
associated with the system, 

where a is the entropy production per unit volume per unit time. Substituting Equations EJ 
El and HI into Equation [TJ 



J ~^r(P s ) dec = — J V • (S + psv ) dx + J a dx. 



(5) 



As this expression must be true for an arbitrary volume, 





n (ps) = -V-(V + psv ) + a. (6) 



This is a continuity equation for the entropy density. The source term, a, represents the 
entropy production within any infinitesimal volume of the system. 
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2.3. Statistical Representations 

From a statistical point of view, entropy is simply a measurement of the number of states 
accessible to a particular system. From the statistical definition of temperature, entropy can 
be calculated using, 

S = k B \nQ, (7) 

where Q is the number of accessible states and k B is the Boltzmann constant which serves to 
give entropy the correct thermodynamic un its. As a res u lt, co unting procedures are key to 



determining specific realizations of entropy. iLynden-Belll ( 119671 ) discusses how there are four 



counting styles that lead to physically relevant situations. Bose-Einstein statistics follow 
from counting states for indistinguishable particles that can co-habitate. When indistin- 
guishable particles are not allowed to share states, Fermi-Dirac statistics emerge. Classical 
Maxwell-Boltzmann (MB) statistics result from counting states available to distinguishable 
particles that can share states. Completing the symmetry, systems where distinguishable 
particles cannot co-occupy states obey what has become known as Lynden-Bell (LB) statis- 
tics (statistics 'IV in Lynden-Bell's original notation). 

Each type of statistics will produce different representations of entropy, but we will focus 
on MB and LB here, both of which dea l with classical distinguishable particles. We briefly 



recap the notation used in ILynden-Belll ( 119671 ) before proceeding with our discussion. The 



usual six-dimensional position-velocity phase-space (x,v) is the setting for determining the 
statistics. Imagine phase-space to be divided into a very large number of nearly infinitesimal 
volumes w called micro-cells. Each micro-cell can either be occupied or unoccupied by one 
of the N phase elements of the system. These phase elements can be thought of as being 
represented by the fine-grained distribution function. This fine-grained distribution function 
is assumed to have a constant value r\ — 1/w. At this level, the phase elements cannot 
co-habitate. If phase-space is also partitioned on a coarser level so that some number of 
micro-cells v occupy a macro-cell, then we can discuss a coarse-grained distribution function. 
The volume of a macro-cell is then vw and the ith macro-cell contains rij phase elements. 
We assume that while the volume of a macro-cell is much larger than that of a micro-cell, it 
is still very small compared to the full extent of phase-space occupied by the system. The 
number of ways of organizing the rn elements into the v micro-cells without co-habitation is, 



{v - m)V 



If the elements were allowed to multiply occupy micro-cells (as in MB statistics) this number 
would be u n *. 



To get the total number of accessible states, the possible ways to distribute the N phase 
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elements into chunks must also be included. iLynden-Belll (119671 ) derives, 



AT' -n- z/' 

In the MB case, the only change is that the factorial ratio in the final product term is 
replaced by v ni . With Equation |HJ the entropy can now be expressed as, 




S'lb = /CB^hiAM-^lnnJ + ^lni/!- 

\ i i 

= k B < N(\nN - 1) + J^i/lni/ - ^[^(lnrtj - 1) + 

L i i 



[y - m) In {v - m)] L (10) 



where we have assumed N 1, rij 3> 1, i/ 3> 1, and used Stirling's approximation. In a 
Maxwell-Boltzmann situation, the familiar entropy expression is, 

Smb = S - kB^riilnrii, (11) 

i 

where So = Nk B In Nv. Note that S'lb reduces to an expression similar to Smb (except for the 
constant) when v 3> n^. In this dilute, non-degenerate limit, the difference between allowing 
and denying co-habitation of states becomes irrelevant. The number of elements occupying 
a macro-cell rij is now replaced by a coarse-grained distribution function of position and 
velocity. The coarse-grained function / is a continuous function of x and v and represents 
the number of occupied micro-cells within macro-cells, 



N = J2 n i = J J fdxdv, (12) 
where the integration is taken over all of phase-space. 



Lynden-Belll (119671 ) goes on to investigate the results of minimizing Equation [10] with 
the constraints of constant system mass and energy. The well-know result of this work is that 
non-degenerate self-gravitating systems do not have a finite mass and energy thermodynamic 
equilibrium. 

We will now describe our investigation into the entropy production that occurs in these 
systems, keeping the assumption that Stirling's approximation is accurate. Note that entropy 
production takes place because we are considering coarse-grained distributions; in other 
words, particles are now allowed to occupy states not accessible within the fine-grained 
world view. At the fine-grained level the distribution function does not change and there is 
no change in entropy. 
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3. Kinetic Theory Picture 

We now proceed to combine the fluid picture of entropy presented in Section 12.21 with 
the statistical picture from Section 12.31 The general procedure will be to find the time rate 
of change of the statistical versions of entropy and equate terms to those in Equation [6j To 
do this, we will rely on the Boltzmann equation. Note that the coarse-grained distribution 
function / does not obey the collisionless Boltzmann equation, rather its evolution is defined 
by, 

^ = _ t ,.v/-o.v w / + r(/) ) (13) 

where a is the acceleration and V„ is the velocity space gradient operator (V„ = d/dv x i + 
d/dvyj + d/dv z k). In standard, ideal gas-like situations Y describes how inter-particle, two- 
body collisions can affect the number of particles in a given phase-space volume. In the 
systems that we are dealing with, V represents the effect of collisionless relaxation processes. 



like y iolent relaxation and phase mixing, which may be aspects of Landau damping (IKandrup 



19981 ). We will refer to V as the relaxation function in subsequent sections. 



3.1. Maxwell-Boltzmann Statistics 



As a simple introduction to the procedure, we begin by discussing a system in the 
Maxwell-Boltzmann regime. Discussion of Lynden-Bell-type systems will follow in Sec- 
tion [3721 From the entropy form given in Equation [TTJ our goal is to transform the summation 
over particles into an integration over phase space. First, we re-write Equation [TT] as 



i 



_So_ 

Nfa 



(14) 



by taking the constant term into the summation. Next, we use the fact that rij = (y/rj)f, 
where / = f(x, v), to produce, 



S 



MB 



&B 
W 



hi 



IniV 



<\x<\v. 



(15) 



The entropy density can now be written as, 

k B 



PSMB = -■ 



ff 


In 1 


- ] - IniV 


dv 


J V 









(16) 



Note that this expression for entropy density differs slightly from other kinetic theory deriva- 
tions in the constant term (In N versus 1). This is due to a different choice for the additive 
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constant in the definition of entropy. As such, it does not affect the behavior we are going 
to investigate. 



Taking a partial time derivative of Equation [TB] results in, 



dt 



(psmb) 



dt 



In 



+ 1 - In A 



dv. 



(17) 



Substituting df /dt from the Boltzmann equation into Equation [T7] results in a lengthy 
expression that we will deal with term by term. For reference, the expression after substitu- 
tion is, 



d f 
^(ps MB ) = ~k B / (-v ■ V/) 

k B J (-a • VJ) 



1-lnA 



( - 

V 

In ( - ) + 1-lnA 

V 



dv 
dv - 



fci 



r 



( - 



1-lnA 



dv. 



(11 



The first integral on the right-hand side of Equation [18] can be recast using integration 
by parts and the fact that v • V/ = V • (fv) in phase-space, 



v ■ V/) 



I - 

V 



1-lniV 



dv 



In N ) v dv. 



(19) 



Since a is velocity-independent, a • V„/ = V„ • af, and we can again use integration by 
parts to transform the second term on the right-hand side of Equation [TS] to, 



a/In I - 



V/] 



dv - In / a • VJ dv. 



(20) 



Using the divergence theorem and the fact that any physical distribution function must 
vanish for large velocities, these integrals vanish. Equation [18] now has the form, 



0_ 

Ft 



(ps 



MB J 



/ In 



In N ) v dv 



In 



+ 1 - In N 



dv. 

(21) 



Assuming the velocity field to be composed of mean and peculiar components v 
vq + v p , we can re-cast Equation [2T1 as. 



|(p*mb) 



-V • psmbVq - k B ' 



f 



(- 



V 



In A ) v p dv 



In ( - ) + 1 - In A 

rj 



dv y 



(22) 
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We now equate the terms in Equation 

5« ■ 



to those in Equation [6] 



psv 0i 



a. 



(23) 



The entropy flux X is given by the integral in the second term on the right-hand side of 
Equation [22] and represents randomly fluxed entropy. The remaining term is the entropy 
production for the system, 



( - 

V 



+ 1 — In TV 



dv. 



(24) 



This equation explicitly demonstrates how the non-collisionless nature of the coarse-grained 
distribution function leads to changes in entropy 

As mentioned in § [TJ thermodynamic non-equilibrium systems can have steady states 
described by extrema of entropy production. Note that we do not extremize the entropy 
itself; that procedure implies a system in thermodynamic equil ibrium (but not necessarily 
with constant kinetic temperature, see iHjorth fc Williams! |2010| ). What we wish to do is to 
set, 5o"mb = 0. Taking the variation of Equation EU we find 



5a 



MB 



( - 

v 



1 - In TV 



(25) 



Since 5f is arbitrary, the variation disappears only when the term in curly braces is zero. 
Note that we did not impose any additional constraints while carrying out the extremization. 
In the standard entropy extremization procedure Langrange multiplier terms are introduced 
to assure constant mass and energy. The condition for an extremum in entropy production 
is. 



S ( in K 



dr 



d(f/v) 



This can be rewritten as, 



dlnT 



( - 



1 



1-lniV 



(f/v) 



0. 



(26) 



(27) 



dln(//77) In (////) + 1 -IniV' 
with the following solution for the relaxation function, 

r m (l-rnAQr M B(/ = ry) (l?R) 
rMB(/) " \n(f/ V ) + l-\nN ' (28) 

where the value of the fine-grained distribution function 77 is the maximum value allowed for 
/. In a collisional system that follows the Maxwell-Boltzmann distribution, like an ordinary 
gas, one could imagine / reaching any value due to collisions. However, for the collisionless 
case, MB statistics are the non-degenerate limit, implying that / <C rj. Figure [1] contains 
plots of Tmb(/) for a variety of values of N. As iV increases, the relaxation function becomes 
more and more uniform. 
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3.2. Lynden-Bell Statistics 



We now investigate a system that obeys Lynden-Bell statistics. The entropy of the 
system can be transformed from the summation in Equation [10] to, 



S 



LB 



f 



M-/ 

7] 



V 



f (r]~ f)\n[ -(V~f) ) dxdv, 



(29) 



where Sq = Nk B (\nN — 1) + k B v\wv. The entropy density can now be written as, 

S 



PSLB = ~k B / / 



V 



1,1 1 n ! > ~ Nk B 



(77 - /)ln ( -(77 - /) ) dv. 



(30) 



Taking a partial time derivative of Equation [30] results in 



|(p*lb) 



df 



In 



/ 



v - f 
f 



c 



dv 



dv + k B C dv, 



(31) 



where C = So/Nk B is a constant. 



Substituting df / dt from the Boltzmann equation into Equation [31] again results in a 
lengthy expression that we will deal with term by term. For reference, the expression after 
substitution is, 



0_ 

Of 



(ps 



LB 1 



dv 



-ka J (-v • V/) In (-Lj) dv - k B J (-a • V v f) In (-L^ 
k B J T In dv + k B J (-v ■ Vf)C dv + k B J (-a ■ V v f)C dv + 

k B [ TCdv. (32) 



The first integral on the right-hand side of Equation [32] can be transformed to, 



dv = V 



/In 



/ 



v dv — 



Jl-fJ J \V~fJ J V~f 

We now re-write the first term on the right-hand side of Equation [33] as 



v • V/ dv. (33) 



/In 



/ 



v- f 



v dv = V 



In I V - S 

77 



V 



ln( -(ri-f) 



v dv. 



(34) 



-12- 



Adding and subtracting terms of the form V • J i]\n [{v/rj){r] — f)]v dv to Equation 1341 gives 
us a term that is very reminiscent of the entropy density in Equation [ 



(v- V/)ln 



/ 



V ~ f 



dv 



V 
V 



fin -/ +(^-/)ln -(77-/) 
V J \V 



v dv — 



/ 77 In ( — (77 — /) ) v dv — / — — -v • V/ dv. 

J \V J J v-f 



Looking at the second term on the right-hand side of Equation [351 we see that 



7 -77 In ( -(V~ f) )v 



V 



v-Vf. 



(35) 



(36) 



We can now simplify Equation I2S1 to 

/ 



J (v • V/) In 



dv = V 



/ln( -/) + (r)-f)\n(-(r)-f) 
V J \V 



v dv. (37) 



Next, we deal with the second integral on the right-hand side of Equation [321 Since a 
is velocity-independent, we can write 



J(a-V v f)\n( 



f 



V~f 



Using 



:V w /)ln 



/ 



dv = a 



fin 



:V„/)ln 



/ 



V~f 



dv. 



f 



'I 



V~f 



(38) 



(39) 



and taking advantage of the velocity independence of a, we can re-write the right-hand side 
of Equation [38] as, 



af In 



/ 



V~f 



dv — 



V 



v-f 



a • V v f dv. 



(40) 



The first term disappears when the divergence theorem is applied, as the distribution function 
goes to zero at large velocities. To deal with the second term, we substitute V v / = —'V v (r] — 
f) to get, 

- J • V,/ dv = V a • J V v In (77 - /) dv. (41) 

Let us investigate one component of this vector integral, 



00 dv x 



In (77 - /) dv x = In (77 - /)| 



max 



In 77 — In 77 = 0, 



(42) 
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since a well-behaved distribution function is expected to disappear at the largest speeds 
possible. So, the second integral on the right-hand side of Equation [32] is zero. 



We now re-combine the terms on the right-hand side of Equation [32] using the results 
of Equations [37] and [38] to produce our final representation of the time rate of change of the 
entropy density, 



|(p*lb) = 
-k B V 



/ 



In 



/ 



In 



/ 



v- f 



V ~ f 

-c 



c 



(n-f)]n[-(rj-f) 



v dv — 



dv. 



(43) 



Again assuming the velocity field to be composed of mean and peculiar components v 
Vo + v p , we draw a correspondence between, 





Of 



{pa 



LB, 



-V ■ ps LB v Q - 



f 



k B 

and Equation [6] 



In 



In 

/ 



/ 



v-f 



v - f 



c 



-c 

dv, 



+ ( v -f)\n[-( V -f) 

7] 



v p dv 



+ psv ) + a. 



(44) 



(45) 



The entropy flux due to random motions S is given by the integral in the second term on the 
right-hand side of Equation [44j The remaining term then makes up the entropy production 
for the system, 

/ 



<t LB = -k B j r |hi [^rj) - CJ dv. (46) 

Again, there is a relaxation function- dependent term in the entropy production. Following 
the same steps as in the Maxwell-Boltzmann case, we find that the condition for the entropy 
production term in Equation US] to be extremized is, 

Q 



r LB (/) 



In [f/(v - /)] - C" 



(47) 



where Q is an integration constant and C = In N — 1 + 1/N'^2 i ulnu. If we set / = rj/2, 
Q = -CT LB (f = V /2) and 

-CT LB (f = v/2) 

Flb(/) " Inif/iv-m-C- (48) 
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Like Tmb, this function behaves more like a constant as the N value increases (C — > oo). 
Tlb curves for a variety of C values are presented in Figure [2^. The increase in Tlb seen 
as f/r) —> 1 is due to In [f/(r) — /)] approaching C. Once / is sufficiently close to r] that 
subtracting C produces a negligible change, i\b 0. The complex behavior of i\b for 
/ ~ r\ is shown in Figure [2b and is discussed further in the next section. 



Discussion & Conclusions 



The seminal paper by iLynden-Belll (119671 ) has shown that, under certain assumptions, 
there is no maximum entropy state for self-gravitating systems. Alternative descriptions of 
the same system s whic h yie ld self-consistent re s ults u nder entropy extremization may be 
found in iMadsenl Jl996h and lliiorth fc Williamsl (bold ). 



Ly nden-Bell's conclusion is exe mplified by the order-of-magnitude calculation in lTremaine. Henon. &: L 



(119861 ); iBinney fc Tremaind (119871 . S. 4.7), using Maxwell-Boltzmann statistics. The result 
of this calculation is that when a collisionless system rearranges its mass to become more 
centrally concentrated in the core, the entropy of the contracting core mass decreases. The 
outer envelope, expanding in response to the contracting core to satisfy the virial theorem, 
should have an increase in entropy. As a result, the entropy for the entire system increases. 
Since a system can always increase its entropy by contracting the core and expanding the 
envelope, there is no maximum entropy state, and hence maximizing entropy will not lead 
to a satisfactory description of a steady state. 

Yet, we know from numerous high-resolution iV-body simulations that long-lived steady 
states do exist. How does one find these theoretically? Apparently, one has to resort to means 
other other than entropy extremization. In this paper we try one alternative approach. We 
apply a principle of extremizing entropy production rate to self-gravitating systems. This 
principle has been used widely to describe thermal non-equilibrium, but not in systems that 
are self-gravitating. 

Our basic hypothesis is that a steady state is obtained by extremizing the entropy pro- 
duction. We present expressions for the entropy production rates for two types of statistics, 
Maxwell-Boltzmann (MB) and Lynden-Bell (LB), as Equations [24] and [461 respectively. We 
then find expressions (Equations [2H] and |4"8"1) for the relaxation term that forms the right 
hand side of the coarse-grained Boltzmann equation. The meaning of these expressions 
and the interpretation of our results, under the assumption that this idea is applicable to 
self-gravitating systems, are discussed below. 
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4.1. Entropy production 



The development of the expressions for entropy production rates a is a central result 
of this work. The descriptions of o for the MB and LB statistical families are given in 
Equations [21] and HHl respectively. Since we are dealing with collisionless systems exclusively, 
one might expect these to be zero. In fact, if we were considering the fine-grained distribution 
function, there would be no entropy change, no thermodynamic evolution, as the collisionless 
df/dt = Boltzmann equation would apply. 

However, we are considering the coarse-grained function. As a system evolves, the 
fine-grained distribution function becomes stretched and twisted in phase-space. Because 
the coarse-grained function averages the fine-grained function with nearby empty regions of 
phase-space, the coarse-grained function changes as the system evolves. Now, recall that 
entropy represents the number of accessible states. On the level of the fine-grained function, 
the number of accessible states stays the same. However, going from a fine-grained to 
coarse-grained description implies that there are now regions of phase-space not occupied 
by the fine-grained function that are accessible to the coarse-grained function. This implies 
that there are more microscopic ways of realizing a given macroscopic state, leading to 
more possible states and larger entropy. Thus, coarse-graining an evolving system results 
in entropy production even in a collisionless system. In terms of physical processes, the 
evolution is due to the larger-scale phase-space evolution of the system driven by collisionless 
relaxation processes, like violent relaxation and phase mixing. 

The above argues that entropy production takes places during evolution of collisionless 
systems. But our analysis shows that entropy production takes place even during the steady 
state. Let us start by writing down the expression for the entropy production during the 
steady-state by combining Equations [24] and [28] for the MB case, 



where Velocity is the volume of occupied velocity space. This is consistent with the second 
law of thermodynamics since Q < and all other terms are positive. A similar expression 
can be found for the LB case, using Equations [46] and [48] Since a steady state is described by 
an unchanging value of a, any non-zero value of a persists even when a system has reached 
mechanical equilibrium. 

It is interesting to think of the source of this continued entropy production. After a 
system stops evolving on the macroscopic scale, it still continues to evolve on ever decreasing 
microscopic scales as the fine-grained function continues to stretch and twist almost indefi- 



omb = -k B J QT M b(v) dv 

= — ^B<5Lmb(/ = ??)Kclocity, 



(49) 
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nitely. The corresponding continual coarse-graining of the ever evolving fine-grained function 
on smaller and smaller scales, results in constant, non-zero entropy production. 

4.2. Interpreting the Boltzmann Equation 

Our expression for the Boltzmann equation states that the relaxation function, T, de- 
termines the rate of change of the coarse-grained distribution function, 

| = r (/) . (50) 

Despite the right hand side being non-zero (given by Equations [2SJ and US] for the MB and 
LB statistics, respectively), the above equation does not contradict the assumption of a 
stationary state. A stationary, or steady, state is the Eulerian viewpoint, i.e., df/dt = 0, 
while the Boltzmann equation above is a Lagrangian viewpoint, df/dt = does not imply 
df/dt = 0. In other words, the relaxation function T does not determine the explicit time- 
dependence of /, which must be zero for stationary states, but rather describes a flux of 
occupied cells through phase-space, as do the velocity-driven (v • V/) and acceleration- 
driven (a ■ V„/) flux terms (c.f. Equation [13]). In the context of the Lagrangian derivative, 
we can think of t simply as a parameter that indicates the location along a particle's or cell's 
path through phase-space. 

In collisional systems, the relaxation function is called the collision term and is usually 
dealt with in a Fokker-Planck approximation scheme. In these systems the particles, through 
two-body encounters, gradually disperse over the whole available phase-space, and so df/dt 
following any given particle in an evolving system does not stay constant, but generally 
decreases with time. In a general collisionless system, this term represents the processes 
like violent relaxation and phase mixing, on the coarse-grained scale. In a steady-state 
collisionless system, the large scale processes like violent relaxation no longer operate and the 
only changes happen on microscopic scales. In this context, the left hand side of Equation 150] 
describes how a particle, or a cell moves through the system (and t is the parameter). 
Therefore it is not unexpected that over some portions of its motion the coarse-grained 
density around it will be increasing and over others, it will be decreasing. For the MB case, 
Tmb > for / > 0, implying that / should continually grow. However, this is impossible as 
the coarse-grained distribution function is limited to a maximum value t]. This contradiction 
arises as MB statistics are valid only when / <C t] so that macro-cells are not multiply 
occupied. On the other hand, the LB case does not present any contradictions with the 
Boltzmann equation. Tlb is zero when / = and / = rj, and is positive over the vast 
majority of the intervening range. This behavior guarantees that when the coarse-grained 
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density reaches its maximum value, the relaxation term disappears and the system behaves 
collisionlessly even at the coarse-grained level. 

To sum up, if extremizing entropy production in self-gravitating systems does lead to 
steady-state configurations, then Equation |50] with the appropriate expressions for T (as given 
by Equations [28] and HSj) describes the steady state of self-gravitating collisionless systems. 
The relaxation term T describes the continual evolution of the coarse-grained distribution 
function, which is due to the combimation of the dynamical evolution of the fine-grained DF 
on microscopic scales, and coarse-graining. 

The authors gratefully acknowledge support from NASA Astrophysics Theory Program 
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Fig. 1. — The behavior of the relaxation function Tmb as a function of the coarse-grained 
distribution function / in a system that obeys Maxwell-Boltzmann statistics. The various 
lines represent functions defined with different N values, where N is basically the number of 
particles in a system. As N increases, the relaxation function becomes more constant. 
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Fig. 2. — a) The behavior of the relaxation function i\b as a function of the coarse-grained 
distribution function / in a system that obeys Lynden-Bell statistics. The various lines 
represent functions defined with different C values, where C = IniV — 1 + l/iV^^i/lnz/. 
As before, N is basically the number of particles in a system, and increasing N results in 
increasing; C. Like the Maxwell-Boltzmann N increases, the relaxation function 

becomes more constant, b) A magnified view of the behavior of IYb (for a fixed C) as 
f — y n. Note that Tin becomes unbound as In \f l(n — fW — > C. but as f — n. Tin — y 0. 



